Click any tag below to further narrow down your results
Links
A former OpenAI safety researcher quit because the company's internal culture prioritizes speed and profit over genuine safety measures, and argues that the entire AI industry's approach to safety is fundamentally broken and will lead to more failures.
- OpenAI's culture systematically deprioritizes safety work in favor of rapid product development and commercial success
- The author claims the industry lacks meaningful accountability mechanisms and treats safety concerns as obstacles rather than legitimate priorities
- Without structural changes to how companies approach AI safety, more serious failures are inevitable
The article examines whether AI company leaders like Dario Amodei are engaging in regulatory capture or actually believe their policy positions. The author argues the evidence points to genuine conviction rather than self-interested industry manipulation.
- Regulatory capture is a slow process of erosion happening behind closed doors—companies lobby Congress, hire former regulators, and gradually shift agencies from confrontation to accommodation, using the ICC's railroad regulation as the classic example.
- Amodei's support for AI regulation would reduce his company's profits, which contradicts the self-interest motive central to regulatory capture theory—if he were capturing regulators, he'd push for deregulation instead.
- The simpler explanation (Occam's razor) is that Amodei actually believes what he's saying about AI safety and regulation, rather than engaging in the complex, hidden machinations that real regulatory capture requires.
Nvidia's CEO pushed back hard on recent whistleblower claims and extinction risk predictions from Anthropic researchers, calling them irresponsible and ungrounded in science. He argued that past AI predictions have consistently failed and that frontier labs should focus on engineering rigor rather than pausing development.
- Huang called the 10%+ extinction risk prediction "made up" and "irresponsible," pointing out that previous doomsday AI forecasts (radiologists disappearing, 90% of coding automated within months) proved completely wrong.
- He defended frontier labs' safety track record, arguing the few incidents that occurred are solvable engineering problems within their control, not signs of uncontrollable systems requiring outside intervention.
- Huang emphasized that both closed and open AI models are necessary—open models enabled $400 billion in venture funding to AI startups in the last six months, with 80% using open-source models.